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Abstract: Herein, we review the properties of the Amoroso distribution, 
the natural unification of the gamma and extreme value distribution fami- 
lies. Over 50 distinct, named distributions (and twice as many synonyms) 

^^ occur as special cases or limiting forms. Consequently, this single simple 

functional form encapsulates and systematizes an extensive menagerie of 

OO interesting and common probability distributions. 
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^~~^ 1. The Amoroso distribution family 

The Amoroso (generalized gamma, Stacy-Mihram) distribution [2, 22] is a 
four parameter, continuous, univariate, unimodal probability density, with semi- 



^ infinite range. The functional form in the most straightforward parameterization 



IS 

Amoroso(x|a, 9, a, /?) 



P 



exp<^- — — (1) 



T{a) 

for X, a, 9, a, /3 in M, a > 0, 
support X > a ii 9 > 0, x < a ii 9 < 



The Amoroso distribution was originally developed to model lifetimes [2]. It 
occurs as the Weibullization of the standard gamma distribution (5) and, with 
integer a, in extreme value statistics (28). The Amoroso distribution is itself a 
limiting form of various more general distributions, most notable the generalized 
beta and generalized beta prime distributions [32] . 

A useful and important property of the Amoroso distribution is that many 
common and interesting probability distributions are special cases or limiting 
forms (See Table 1). (Informally, an "interesting distribution" is one that has 
acquired a name, which generally indicates that the distribution is the solu- 
tion to one or more interesting problems.) This provides a convenient method 
for systemizing a significant fraction of the probability distributions that are 
encountered in practice, provides a consistent parameterization for those dis- 
tributions, and to obviates the need to enumerate the properties (mean, mode, 
variance, entropy and so on) of each and every specialization. 

Notation: The four real parameters of the Amoroso distribution consist of a 
location parameter a, a scale parameter 9, and two shape parameters, a and /3. 
Whenever these symbols appears in special cases or limiting forms, they refer 
directly to the parameters of the Amoroso distribution. The shape parameter a 
is positive, and in many specializations an integer, a = n, or half- integer, a = 2 • 
The negation of a standard parameter is indicated by a bar, e.g. /3 = —(3. The 
chi, chi-squared and related distributions are traditionally parameterized with 
the scale parameter a, where 9 = (2(j^)^/^, and a is the standard deviation of 
a related normal distribution. Additional alternative parameters are introduced 
as necessary. 

We write Amoroso(x|a, 9, a, /3) for a density function, Amoroso(a, 9, a, 13) for 
the corresponding random variables, and X ^ Amoroso(a, 9, a, (3) to indicate 
that two random variables have the same probability distribution [15]. Recall 
that a "random variable" is an unbound function from events to values, whereas 
the probability density function maps from values to probabilities. 

1.1. Special cases: Miscellaneous 



Stacy (hyper gamma, generalized Weibull, Nukiyama-Tanasawa, generalized 
gamma, generalized semi-normal, hydrograph, Leonard hydrograph, transformed 
gamma) distribution [41, 6]: 



Stacy(x|0, a. 



/3 



(?)°"'-{-(i)l (^) 



r(a) 

:Amoroso(x|0, 9, a, (3) 



If we drop the location parameter from Amoroso, then we obtain the Stacy, or 
generalized gamma distribution, the parent of the gamma family of distribu- 
tions. If (3 is negative then the distribution is generalized inverse gamma. 



Table 1 
The Amoroso family of distributions. 



Amoroso(a;|a, d, a, /3) 
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cxp 

Q > 



13 (x-ayf^-^ 

T{a) e \e^) 

for X, a, 9, a, /3 in ' 
k, n positive integers 
support a:: > a if 6 > 0, x < a ii 8 < 0. 



(1) 


Amoroso 


a 


e 


a 


/3 


(2) 


Stacy 











(28) 


gen. Fisher-Tippett 








n 




(29) 


Fisher-Tippett 








1 




(33) 


Frechet 








1 


<0 


(32) 


generalized Frechet 








n 


<0 


(25) 


scaled inverse chi 











-2 


(26) 


inverse chi 





1 

^/2 


_2 


(27) 


inverse Rayleigh 







1 


_2 


(19) 


Pearson type V 








-1 


(20) 


inverse gamma 









-1 


(23) 


scaled inverse chi-square 









-1 


(24) 


inverse chi-square 





1 

2 


-1 


(22) 


Levy 






1 

2 


-1 


(21) 


inverse exponential 







1 


-1 


(7) 


Pearson type III 










(5) 


gamma 











(5) 


Erlang 





>0 


n 




(6) 


standard gamma 





1 






(13) 


scaled chi-square 











(12) 


chi-square 





2 




(9) 


shifted exponential 






1 




(8) 


exponential 







1 




(8) 


standard exponential 







1 




(5) 


Wien 







4 




(10) 


Nakagami 








2 


(15) 


scaled chi 







¥ 


2 


(14) 


chi 





V2 


¥ 


2 


(11) 


half-normal 







1 

2 


2 


(16) 


Rayleigh 







1 


2 


(17) 


Maxwell 







3 

2 


2 


(18) 


Wilson-Hilferty 
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Fig 1. Amoroso(x|0, 1, 1, /9), stretched exponential 



the parent of various inverse distributions, including the inverse gamma (20) 
and inverse chi (26). 

The Stacy distribution is obtained as the positive even powers, modulus, and 
powers of the modulus of a centered, normal random variable (43), 



Stacy ( (2cr2) /3 , i, /3 I ~ Normal(0, a) 



and as powers of the sum of squares of k centered, normal random variables. 



Stacy (2fT2)/3,ifc,/3 



^ ('Normal(0, a] 



vi=l 



Stretched exponential distribution [27]: 



StretchedExp(x|0,/3) -^^ (^)^ 'expj- (| 



(3) 



for ;3 > 
=Weibull(a;|0,6i,/3) 
=Amoroso(a;|0, 6, 1, /3) 

Stretched exponentials are an alternative to power laws for modeling fat tailed 
distributions. For /3 = 1 we recover the exponential distribution (8), and /3 = 
a power law distribution (44). 
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Fig 2. Amoroso(a:|0, 1, 2, 



Pseudo-Weibull distribution [441 



PseudoWeibull(x|0,/3) = ^^^\,^ ^^ (|)%xp|- ( 

for /3 > 
==Amoroso(x|0,6',l + j,P) 

Proposed as another model of failure times. 
1.2. Special cases: Positive integer (3 



1)J 



(4) 



Gamma (F) distribution [35, 36, 22] 
Gamma(x|0, a) = 



1 



Q-l 



exp 



{-i} 



(5) 



r(a)|6i| \e 

PearsonIII(x|0, 9, a) 
Stacy(a;|0,a, 1) 
Amoroso(x|0, 9^ a, 1) 



The name of this distribution derives from the normalization constant. The 
gamma distribution often appear as a solution to problems in statistical physics. 
For example, the energy density of a classical ideal gas, or the Wien (Vienna) 
distribution Wien(a;|r) = Gamma(a;|T, 4), an approximation to the relative 
intensity of black body radiation as a function of the frequency. The Erlang (m- 
Erlang) distribution [8] is a gamma distribution with integer a, which models the 
waiting time to observe a events from a Poisson process with rate 1/9 {9 > 0). 




Fig 3. Gamma{x| — ,a) (unit variance) 



Gamma distributions obey an addition property: 

Gamma(0, ai) + Gamma(0, 02) ^ Gamma(0, ai + a2) 

The sum of two independent, gamma distributed random variables (with com- 
mon 0's, but possibly different a's) is again a gamma random variable [22]. 



Standard gamma (standard Amoroso) distribution [22]: 

1 



StdGamma(x|a) = ^^7^2;" ^e "^ 
r(a) 



(6) 



The Amoroso distribution can be obtained from the standard gamma distribu- 
tion by the WeibuU change of variables, x i->- (^^) ■ 

r iV/S 

Amoroso(a, 9,a, f^) ^ a + 9 StdGamma(a) 



Pearson type III distribution [36, 22]: 
PearsonIII(x|a, 6, a) 



X — a 



exp 



(7) 



na)\9\ V 
=:Amoroso(a;|a, 9, a, 1) 

The gamma distribution with a location parameter. 

Exponential (Pearson type X, waiting time, negative exponential) distribu- 
tion [22]: 



Exp(.|.).^exp{-^} 



1^1 
Gamma(a;|0, 1) 

Amoroso(a;|0, 9, 1, 1) 



(8) 



An important property of the exponential distribution is that it is memory- 
less: the conditional probability given that x > c, where c is a positive content, 
is again an exponential distribution with the same scale parameter. The only 
other distribution with this property is the geometric distribution [9], the dis- 
crete analog of the exponential distribution. With = 1 we obtain a standard 
exponential distribution. See also shifted exponential (9), stretched exponen- 
tial (3) and inverse exponential (21). 

Shifted exponential distribution [22]: 

ShiftExp(x|a, 0) = 1 exp |- {^^ } (9) 

= PearsonIII(x|a, 6*, 1) 
= Amoroso(a::|a, 9, 1, 1) 

The exponential distribution with a location parameter. 

Nakagami (generalized normal, Nakagami-m) distribution [34]: 

Nakagami(2;|a,6l,m) = — — — f ^^j expi-f^-^j I (10) 

= Amoroso(a::|a,0, ™, 2) 

Used to model attenuation of radio signals that reach a receiver by multiple 
paths [34]. 

Half-normal (semi-normal, positive definite normal, one-sided normal) distri- 
bution [22]: 

HalfNormal(.la) = -^ exp {- (^) } (11) 

= ScaledChi(a;|cr, 1) 

= Stacy(j;|V2^, i,2) 

= Amoroso(a;|0, ^2^, \,2) 

The modulus of a normal distribution with zero mean and variance a'^ . 

Chi-square (x^) distribution [11, 22]: 

ChiSqr(.l.).^(|)^-%xp{-(|)} (12) 

for positive integer k 
— Gamma(x]2, |) 
= Stacy(xl2,|,l) 
= Amoroso (a; JO, 2, |,1) 




Fig 4. ChiSqr(a;|fc) 



The distribution of a sum of squares of k independent standard normal random 
variables. The chi-square distribution is important for statistical hypothesis test- 
ing in the frequentist approach to statistical inference. 



Scaled chi-square distribution [28]: 



ScaledChiSqr(a;|i7, k) 



1 



2a2r(|) 



i^y '^"p{-(2^)} 



(13) 



for positive integer k 
Stacy(a;|2(T 



2 k 



1) 



= Gamma(a;|2cr^, |) 

= Amoroso(x|0, 2(t^, |, 1) 

The distribution of a sum of squares of k independent normal random variables 
with variance a^. 



Chi (x) distribution [22]: 
Chi{x\k) 



fe-i 



exp 



(14) 



V2 / X 

f(|)VVl. 

for positive integer k 
= ScaledChi(a;|l,A:) 

= Stacy(x|y2, |,2) 

= Amoroso(a;|0, \/2, |, 2) 

The root-mean-square of /c independent standard normal variables, or the square 
root of a chi-square random variable. 

Chi(fc) - VChiSqr(/c) 



1.5 r 



a=1/2, half-normal 



a=1, Rayleigh 



a=3/2, Maxwell 




Fig 5. Amoroso(x|0, l,a,2) 



Scaled chi (generalized Rayleigh) distribution [33, 22] 

fc-i 



ScaledChi(a;|cr, fc) = 



r(f)V2a2 



for positive integer k 
Stacy(a;|%/2^, |,2) 
Amoroso(a::|0, V2a'^, |, 2) 



cxp 



X 
2f72 



(15) 



The root-mean-square of k independent and identically distributed normal vari- 
ables with zero mean and variance a^. 



Rayleigh distribution [42, 22]: 



1 



Rayleigh(a:;|(T) = ^ x exp 



(16) 



X 

a- - t V2^ 

= ScaledChi(a;|cr,2) 

= Stacy(2;|\/2^, 1,2) 

= Amoroso(a;|0, \/2g'^, 1, 2) 

The root-mean-square of two independent and identically distributed normal 
variables with zero mean and variance tr^. For instance, wind speeds are approx- 
imately Rayleigh distributed, since the horizontal components of the velocity are 
approximately normal, and the vertical component is typically small [24]. 



/ 10 

Maxwell (Maxwell-Boltzmann, Maxwell speed) distribution [30, 1]: 

Maxwell(xla) = -^ .^ exp {- (^) | (17) 

= ScaledChi(x|cr, 3) 

= Stacy(x|y2^, |,2) 

= Amoroso(a;|0, ^2(72^ |^2) 

The speed distribution of molecules in thermal equilibrium. The root-mean- 
square of three independent and identically distributed normal variables with 
zero mean and variance u^ . 

Wilson-Hilferty distribution [47, 22]: 

WilsonHilferty(a:|^,a) = ^ (i)""-p{- Q'] d^) 

= Stacy(x|0,a,3) 

= Amoroso(j;|0, 6*, a, 3) 

The cube root of a gamma variable follows the Wilson-Hilferty distribution [47] , 
which has been used to approximate a normal distribution if a is not too small. 
A related approximation using quartic roots of gamma variables [19] leads to 
Amoroso(a::|0, 6*, a, 4). 



1.3. Special cases: Negative integer (3 

Pearson type V distribution [37]: 

I / a \ "+i 



PearsonV(xla,6l,Q!) = exp 

1 (a) jo'l \x — a ) 

=Amoroso(x]a, 61,0;, —1) (19) 

With negative /3 we obtain various "inverse" distributions related to distribu- 
tions with positive /3 by the reciprocal transformation (^^) H' (;jz:^)- Pearson's 
type V is the inverse of Pearson's type III distribution. 

Inverse gamma (Vinci) distribution [22]: 

1 / n\ a+1 



InvGamma(a::|6', a) = j^, ,,^, ( - 1 cxp j - ( - ) }■ (20) 

= Stacy(a;10,a, —1) 
= PearsonV(a::]0, Q, a) 
— Amoroso(x]0, 0, a, —1) 



11 
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Fig 6. Amoroso(2:|0, l,2,/3), negative /3. 



Occurs as the conjugate prior for an exponential distribution's scale parame- 
ter [22], or the prior for variance of a normal distribution with known mean [15]. 



Inverse exponential distribution [25]: 

InvExp(a;|6l) = i^expj- ("-H (21) 

— InvGamma(x|0, 1) 

= Stacy(a;|6',l,~l) 

= Amoroso(a;|0, 6, 1, —1) 

Note that the name "inverse exponential" is occasionally used for the ordinary 
exponential distribution (8). 

Levy distribution (van der Waals profile) [10]: 



Levy(x|a,c) = ^ _ ^-—^ exp | - ^^— -^ | (22) 

= PearsonV(a;|a, |, ^) 
= Amoroso(a;|a, |, 5,-1) 

The Levy distribution is notable for being stable: a linear combination of iden- 
tically distributed Levy distributions is again a Levy distribution. The other 
stable distributions with analytic forms are the normal distribution (43), which 
is also a limit of the Amoroso distribution, and the Cauchy distribution [22], 
which is not. Levy distributions describe first passage times in one dimensional 
Brownian diffusion [10]. 
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Scaled inverse chi-square distribution [15]: 

ScaledInvChiSqr(x|a, k) .||^ ( J^) '" exp {- ( J^) } (23) 

for positive integer k 
= InvGaninia(a;| 2^, 2) 
= PcarsonV(x|0, ^, |) 
= Stacy(2; I 2^2,1,-1) 
= Amoroso(x|0, 2^, |, —1) 

A special case of the inverse gamma distribution with half-integer a. Used as a 
prior for variance parameters in normal models [15]. 

Inverse chi-square distribution [15]: 

\ -+i ^ / - 

1 \ ' f /I 



InvChiSqr(.lfc) .^ ^-j exp|-^-)^ (24) 

for positive integer k 
= ScaledInvChiSqr(2;|l,/c) 



InvGamma(a;|^, |) 
PearsonV(a:|0, \, |) 

2' 2' ~ 



Stacy(x|i,|,-1) 



= Amoroso(x|0, ^, |, —1) 
A standard scaled inverse chi-square distribution. 
Scaled inverse chi distribution [28]: 

2^2^/ 1 '''+' 



ScaledInvChi(x|a, k) = ^^ l^T^p; j °^P j" (^^^5^ j ^ (^5) 

= Stacy(a:|^,|,-2) 
= Amoroso(a:|0, -7=5, |, -2) 

Used as a prior for the standard deviation of a normal distribution. 
Inverse chi distribution [28]: 

InvChi(xlfc) = ^ ( ^ ) exp ^ - ( -^ ) ^ (26) 



2V2 / 1 \^'+' r 


/ 1 
1^2x2 


Stacy(x|^,|,-2) 




Amoroso(x|0,^,|,-2) 
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Fig 7. Extreme value distributions 



The standard inverse chi distribution. 
Inverse Rayleigh distribution [9]: 



1 ^^ 



InvRayleigh(a;|a) = 2V2a2 (^^==- j '^''P \ (,2a^ j / ^^^^ 

= Stacy(a:|^,l,-2) 
= Amoroso(a;|0, -7^, 1, -2) 

The inverse Rayleigh distribution has been used to model a failure time [43]. 
1.4- Special cases: Extreme order statistics 
Generalized Fisher-Tippett distribution [40, 3]: 



GenFisherTippett(a;|a, w, n, /3) 



r(n) 



/? 



n/3-1 

X — a^ 

exp < —77, 




for positive integer n 
= Amoroso(x|a, Lojn^ , n, /3) 

If we take A^ samples from a probability distribution, then asymptotically for 
large N and n <^ N, the distribution of the nth largest (or smallest) sample 
follows a generalized Fisher-Tippett distribution. The parameter /3 depends on 
the tail behavior of the sampled distribution. Roughly speaking, if the tail is 
unbounded and decays exponentially then /3 limits to cx), if the tail scales as a 
power law then /3 < 0, and if the tail is finite /3 > [17]. In these three limits 
we obtain the Gumbel (39, 38), Frechet (33, 32) and Weibull (31,30) families 
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of extreme value distribution (Extreme value distributions types I, II and III) 
respectively. If (3 /uj is negative we obtain distributions for the nth maxima, if 
positive then the nth minima. 

Fisher-Tippett (Generalized extreme value, GEV, von Mises-Jenkinson, von 
Mises extreme value) distribution [12, 45, 17, 23]: 



FisherTippett(a::|a, oj,/?) — 



P 



X — a\ I X ~ a^ 



exp<^-^^ (29) 



= GenFisherTippett(x|a, w, 1, /3) 
= Amoroso(a;|a, w, 1, /3) 

The asymptotic distribution of the extreme value from a large sample. The 
superclass of type I, II and III (Gumbel, Frechet, WeibuU) extreme value dis- 
tributions [45]. This is the distribution for maximum values with /3/aj < and 
minimum values for (3 /uj > 0. 

The maximum of two Fisher-Tippett random variables (minimum if P/tu > 0) 
is again a Fisher-Tippett random variable. 

max Fisher Tippett(a, wi, /3), FisherTippett(a, W2, / 

~ FisherTippett(a, -^^ '^ ,/3) 

This follows because taking the maximum of two random variables is equivalent 
to multiplying their cumulative distribution functions, and the Fisher-Tippett 
cumulative distribution function is exp < — (^^) >■ 

Generalized Weibull distribution [40, 3]: 

n" /3 fx-aY'^~^ 

GenWeibulhxja, w, n,/3) = -: — r exp 

r(n) \oj\\ oj J 

for /3 > 

= GcnFisherTippett(a::|a, to, n, /3) 

= Amoroso(x|a, uj/n'^ , n, /3) 

The limiting distribution of the nth smallest value of a large number of identi- 
cally distributed random variables that are at least a. If uj is negative we obtain 
the distribution of the nth largest value. 

Weibull (Fisher-Tippett type III, Gumbel type III, Rosin-Rammler, Rosin- 
Rammler- Weibull, extreme value type III, Weibull-Gnedenko) distribution [46, 
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23]: 



Weibull(x|a,o.,/3)= i^f ^— ^j exp <^ - f ^ j \ (31) 

for /3 > 
= Fisher Tippett(a;|a, w, (3) 
— Amoroso(a;|a,a;, 1, /3) 

This is the limiting distribution of the minimum of a large number of identically 
distributed random variables that are at least a. If uj is negative we obtain a 
reversed Weibull (extreme value type III) distribution for maxima. Special 
cases of the Weibull distribution include the exponential {(5 — 1) and Rayleigh 
{(3 = 2) distributions. 

Generalized Prechet distribution [40, 3]: 

GenFrechet(a;|a,a;,n, /3) = - — r 

r(n) \uj\ 

for /3 > (32) 

= GcnFisherTippett(x|a, uj, n, —/3) 

= Amoroso(a;|a,a;/n3 , n, — /3), 

The limiting distribution of the nth largest value of a large number identically 
distributed random variables whose moments are not all finite and are bounded 
from below by a. (If the shape parameter uj is negative then minimum rather 
than maxima.) 

Ftechet (extreme value type II , Fisher- Tippett type II, Gumbel type II, inverse 
WeibuU) distribution [13, 17]: 

Frechet(a;|a,w,^) = ^ (^^) exp | - (^^) I (33) 

for /3 > 
= FisherTippett(a;|a, uj, — /3) 
= Amoroso(a;|a, w, 1, — /3) 

The limiting distribution of the largest of a large number identically distributed 
random variables whose moments are not all finite and are bounded from below 
by a. (If the shape parameter uj is negative then minimum rather than maxima.) 
Special cases of the Frechet distribution include the inverse exponential {/3 — 1) 
and inverse Rayleigh {^ = 2) distributions. 



1 . 5. Properties 
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support X > a 
X < a 

cdf 1 - Q{a, 



( x—a \ P 



Y) 



a^/3^ 



Q(«,(^)') 

mode a + 9{a-l)^ 



std. moments — „, , (a = 0,6* = 1) 



mean a + 9 
variance 6^ 



Via) 



r{a) 



r(a+§) r(a+i)2 



T{a) 



T{af 



entropy In — — Va+ \--a] V'(a) 



6>Q 
<0 

^ >0 

^ <0 

aP> 1 

a/3< 1 



a+^>0 



^>0 



- > 



[6] 



Here, cdf is the cumulative distribution function, Q{a,x) = T(a,x)/T{a) is 
the regularized gamma function [1], T(a,x) = J i"~^e~*cii is the incomplete 
gamma integral [1], and ^'(2;) = s^^-'^(^) ^^ ^^^ digamma function [1], the 
logarithmic derivative of the gamma function. Important special cases and lim- 
its include T{^) = y^, T{^,x) = ^/^^eric{^/x) and r(l,x) — cxp{~x). The 
derivative of the regularized gamma function is ^Q{a,x) = —YT^x^^^e^^ . 

The profile of the Amoroso distribution is bell shaped for af3 > 1, and other- 
wise L- or J- shaped with the mode at the boundary. The moments are undefined 
if the side conditions are not satisfied. Expressions for skew and kurtosis are not 
simple, but can be deduced from the moments if necessary. 

The Amoroso distribution can be obtained from the standard gamma dis- 
tribution (6) with the change of variables, x 1— )■ (^^) • Therefore, Amoroso 
random numbers can be obtained by sampling from the standard gamma dis- 
tribution, for instance using the Marsaglia-Tsang fast gamma method [29] and 
applying the appropriate transformation [26]. 
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2. Log-gamma distributions 

The log-gamma (Coale-McNeil) distribution [4, 39, 23] is a tliree parameter, 
continuous, univariate, unimodal probability density with infinite range. The 
functional form in the most straightforward parameterization is 

LogGamma(a;|t^, A, a) = cxplai — — j - exp f — — j ^ (34) 

for X, V, A, a, in M, a > 0, 
support — oo < X < oo 

The three real parameters consist of a location parameter v^ a scale parameter 
A, and a shape parameter a, which is inherited directly from the Amoroso 
distribution. 

The name "log-gamma" arises because the standard log-gamma distribution 
is the logarithmic transform of the standard gamma distribution 

StdLogGamma(Q;) ^ In I StdGamma(Q;) ) 
LogGamma(i^, A, a) ^ In I Amoroso(0, e"^, a, ■^) 

Note that this naming convention is the opposite of that used for the log-normal 
distribution (42). The name "log-gamma" has also been used for the antilog 
transform of the generalized gamma distribution, which leads to the unit-gamma 
distribution [18]. 

The log-gamma distribution is a limit of the Amoroso distribution (1), and 
itself has a number of important limits and special cases (Table II) , which we 
will discuss below. 

LogGamma(2;]i^, A, a) (35) 

1 / Ix-uY^'^ \ ( Ix-v^''" 
hm 1 + o — ^ — exp < - 1 



/3^oor(a)iA| V/3Ay ^[VpA 

= hm Amoroso(i^ — /3A,/3A,a,/3) 
Recall that lim^^oo(l + f )^ = exp(a;). 
2.1. Special cases 

Standard log-gamma distribution: 

StdLogGamma(x]a) = exp {ax — exp(x)} (36) 

r(a) 

=LogGamma(x]0, 1, a) 
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Table 2 
The log-gamma Jam,ily of distributions. 



LogGamma(x|i', A, a) 

1 ( f X — i'\ f X — V 

exp < a I I — cxp 



r(a)|A| -^ I V A 
for X, V, A, a, in M, a > 0, 
support — cxD < X < oo 

(34) log-gamina v A 



(36) 


standard log-gamma 





1 


a 




(37) 


log-chi-square 


In 2 


1 


k 
2 




(38) 


generalized Gumbel 






n 




(39) 


Gumbel 






1 




(41) 


BHP 






TV 

2 




(40) 


standard Gumbel 
Limits 





-1 


1 




(43) 


normal 






a 


limQ,_).oo 



The log-gamma distribution with zero location and unit scale. 
Log-chi-square distribution [28]: 

1 { k 1 

LogChiSqr(a::|fc) = , exp {^x-- exp(a;) 

for positive integer k (37) 

= LogGamma(a::| ln2, 1, |) 

The logarithmic transform of the chi-square distribution (12). 

Generalized Gumbel distribution [17, 23]: 

GenGumbel(a;|u, A,7i) — - exp < —n — = — ) — nexp 

r(n)|A| L V A / 

for positive integer n (38) 

= LogGamma(x|u -I- A Inn, —A, n) 

The limiting distribution of the nth largest value of a large number of unbounded 
identically distributed random variables whose probability distribution has an 
exponentially decaying tail. 

Gumbel (Fisher- Tippett type I, Fisher-Tippett-Gumbel, FTG, Gumbel-Fisher- 
Tippett, log-WeibuU, extreme value (type I), doubly exponential, double expo- 
nential) distribution [12, 17, 23]: 

Gumbel(a;|u, A) = -^ exp <^ - f -j— j - exp i j— j I (39) 

= LogGamma(a;|w, —A, 1) 
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0.5 - 




Fig 8. LogGamma(x|0, 1,q) 



This is the asymptotic extreme value distribution for variables of "exponential 
type", unbounded with finite moments [17]. With positive scale A > 0, this 
is an extreme value distribution of the maximum, with negative scale A < 
(A > 0) an extreme value distribution of the minimum. Note that the Gumbel 
is sometimes defined with the negative of the scale used here. 

Note that the term "double exponential distribution" can refer to either the 
Gumbel or Laplace [23] distributions. The Gompertz distribution is a truncated 
Gumbel distribution [23]. 

Standard Gumbel (Gumbel) distribution [17]: 

StdGunibel(a;) =exp {-x - e""=} (40) 

=LogGamma(x|0, —1,1) 

The Gumbel distribution with zero location and a unit scale. 
BHP (Bramwell-Holdsworth-Pinton) distribution [5]: 

BHP(.kA).j^cxp{^(i^)-exp(i^)} (41) 

TT 

= LogGamma(x|z/, A, — ) 

Proposed as a model of rare fluctuations in turbulence and other correlated 
systems. 
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2.2. Properties 



support — CX3 < x < +00 

cdf l-g(a,e'^) forA>0 



Q{a, e ^ ) for A < 

a + , 



cgf .t + ln^%±^ [23] 



mode V — A In a 

mean v + A?/'(a) 

variance A V'i(q^) 

skew sgn(A)7/;2(a)/V'i(a)'^'^ 

kurtosis V'3(a)/V-'i(Q!)^ 

entropy lnr(a)|A| — a%lj{a) + a 

Here, cdf is the cumulative distribution function, cgf the cumulant generating 
function, lnE[exp(iX)], sgn(z) is the sign function, tjjniz) = ^^lnr(z) is the 
polygamma function and ip{z) = ipo{z) is the digamma function. 

3. Miscellaneous limits 



Log-normal (Galton, Galton-McAlister, antilog-normal, logarithmic-normal, 
logarithmico-normal, Cobb-Douglas, A) distribution [14, 31, 22]: 



LogNormal(a;|a, d, a) 




lim Amoroso(x|a, ^ifiaf/l^, l/(/3c^)^ (3) 



The log-normal distribution is a limiting form of the gamma family. To see this, 
make the requisite substitutions, 



Amoroso(a;|a, i?(/3cr)2/'^, l/(/3cr)2, /3) 
f X — a\ ( 1 X — a 1 






and in the limit /3 — ?> expand the second exponential to second order in /?. 

With a = 0, ■!? = 1, cr = 1 we obtain the standard log-normal (Gibrat) 
distribution [16]. The two-parameter lognormal distribution (a — 0) arises 
from the multiplicative version of the central limits theorem: When the sum of 
independent random variables limits to normal, the product of those random 
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variables limits to log-normal. The log-normal distribution maps to the normal 
distribution with the transformation x i~> exp(2;). 



LogNormal(a, d, a) ~ exp ( Normal(ln i9, a) 



Normal (Gauss, Gaussian, bell curve, Laplace-Gauss, de Moivre, error, Laplace's 
second law of error, law of error) distribution [7, 22]: 

Normal(x|M,cx) = y^-pj-^^^} (^3) 

= lim Amoroso(a;|/i — ffy^i 0"/%/^! Qfi 1) 

a— 5-00 

~ lim LogGamma(a;|/x — (T-v/alna, (T-\/a, a) 

o— >-oo 

With /I = and g = l/^/2h we obtain the error function distribution, and 
with ji — Q and ct = 1 we obtain the standard normal ($, z, unit normal) 
distribution. In the limit that cr — )■ oo we obtain an unbounded uniform (flat 
distribution, and in the limit cr — > we obtain a delta (degenerate) distribution. 
The normal distribution is a limit of the Amoroso [22] and log-gamma dis- 
tributions [39]. For Amoroso, make the requisite substitutions, 

Amoroso(a;|^ — a\/a, a j \/a, a, 1) 

ex exp < — va h (a — 1) m 1 ' 



and expand the logarithm as ln(l + x) = a; — ^ -|- 0{x^). 
Power- law (Pearson type XI, fractal) distribution [38]: 

PowerLaw(x|p) ex r— (44) 

= lim Amoroso(a,6',a, (1 — p)/q;) 

Improper (unnormalizable) power law distributions are obtained as a limit of the 
gamma distribution family. If p = we obtain the half-uniform distribution 
over the positive numbers; if p = 1 we obtain Jeffreys distribution [21], used 
as an uninformative prior in Bayesian probability [20]. 
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Appendix A: Index of distributions 

generalized-X The only consistent meaning is that distribution "X" is a spe- 
cial case of the distribution "generalized-X" . In practice, often means "add a 
shape parameter" . 

standard-X The distribution "X" with the location parameter set to 0, scale 
to 1, and often the WeibuU shape parameter /3 to 1. Not to be confused with 
standardized which generally indicates zero mean and unit variance. 

shifted-X (or translated) A distribution with an additional location parame- 
ter. 

scaled-X (or scale-X) A distribution with an additional scale parameter. 

inverse-X (Occasionally inverted-X, reciprocal-X, or negative-X) Generally 
labels the transformed distribution with a; i— ^ - , or more generally the distribu- 
tion with the WeibuU shape parameter negated, /3 — )■ — /3. An exception is the 
inverse normal distribution [22]. 

log-X If X follows distribution X then either y — lux (e.g. log-normal) or 
y = e^ (e.g. log-gamma) follows log-X. This ambiguity arrises because although 
the second convention is more logical, the log-normal convention has historical 
precedence. 

reversed-X (Occasionally negative-X) The scale is negated. 

X of the Nth kind See "X type N" . 

Distribution Synonym or Equation 

X chi 

X^ chi-square 

r gamma 

A log-normal 

$ standard normal 

antilog-normal log-normal 

Amaroso (1) 

bell curve normal 

BHP (41) 
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Bramwell-Holdsworth-Pinton BHP 

chi (14) 

chi-square (12) 

Coale-McNeil generalized log-gamma 

Cobb-Douglas log- normal 

de Moivre normal 

degenerate delta 

delta See normal (43) 

doubly exponential Gumbel 

double exponential Gumbel or Laplace 

Erlang See gamma (5) 

error normal 

error function See normal (43) 

exponential (8) 

extreme value Gumbel 

extreme value type N Fisher-Tippett type N 

Fisher-Tippett (29) 

Fisher-Tippett type I Gumbel 

Fisher-Tippett type II Frechet 

Fisher-Tippett type III WeibuU 

Fisher-Tippett-Gumbel Gumbel 

fractal power law 

flat uniform 

Frechet (33) 

FTG Fisher-Tippett-Gumbel 

Galton log-normal 

Galton-McAlister log-normal 

gamma (5) 

Gaussian normal 

Gauss normal 

generalized gamma Stacy or Amoroso 

generalized inverse gamma See Stacy (2) 

generalized Gumbel (38) 

generalized extreme value Fisher-Tippett 

generalized Fisher-Tippett (28) 

generalized Frechet (32) 

generalized inverse gamma generalized gamma 

generalized normal Nakagami 

generalized Rayleigh scaled chi 

generalized semi-normal Stacy 

generalized Weibull (30) 

GEV generalized extreme value 

Gibrat standard log-normal 

Gumbel (39) 

Gumbel-Fisher-Tippctt Gumbel 

Gumbel type N Fisher-Tippett type N 
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half-normal (11) 

half-uniform See power law (44) 

hydrograph Stacy 

hyper gamma Stacy 

inverse chi (26) 

inverse chi-square (24) 

inverse exponential (21) 

inverse gamma (20) 

inverse Rayleigh (27) 

inverse WeibuU Frechet 

Jeffreys See power law (44) 

Laplace's second law of error normal 

Laplace-Gauss normal 

law of error normal 

Leonard hydrograph Stacy 

Levy (22) 

log-chi-square (37) 

log-gamma (34) 

log-normal (42) 

log-normal, two parameter See log-normal (42) 

log- WeibuU Gumbel 

logarithmic- normal log- normal 

logarithmico-normal log-normal 

Maxweh (17) 

Maxwell-Boltzmann Maxwell 

Maxwell speed Maxwell 

m-Erlang Erlang 

Nakagami (10) 

Nakagami-m Nakagami 

negative exponential exponential 

normal (43) 

Nukiyama-Tanasawa generalized gamma 

one-sided normal half-normal 

Pearson type III (7) 

Pearson type V (19) 

Pearson type X exponential 

Pearson type XI power law 

positive definite normal half-normal 

power law (44) 

pseudo- WeibuU (4) 

Rayleigh (16) 

Rosin-Rammler WeibuU 

Rosin- Rammler- WeibuU WeibuU 

scaled chi (15) 

scaled chi-square (13) 

scaled inverse chi (25) 
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scaled inverse chi-square (23) 

semi-normal half- normal 

shifted exponential (9) 

Stacy (2) 

Stacy-Mihram Amoroso 

standard Amoroso standard gamma 

standard exponential See exponential (8) 

standard gamma (6) 

standard Gumbel (40) 

standard log-gamma (36) 

standard log-normal See log-normal (42) 

standard normal See normal (43) 

stretched exponential (3) 

transformed gamma Stacy 

uniform See normal (43) 

unit normal standard normal 

van der Waals profile Levy 

Vienna Wien 

Vinci inverse gamma 

von Mises extreme value Fisher-Tippett 

von Mises- Jenkinson Fisher-Tippett 

waiting time exponential 

WeibuU (31) 

WeibuU-Gnedcnko Weibull 

Wien See gamma (5) 

Wilson-Hilferty (18) 

z standard normal 



References 

[1] Abramowitz, M. and Stegun, I. A., Eds. (1965). Handbook of math- 
ematical functions with formulas, graphs, and mathematical tables. Dover, 
New York. 

[2] Amoroso, L. (1925). Richerche intorno alia curve die redditi. Ann. Mat. 
Pura Appl. 21, 123-159. 

[3] Barndorff-Nielsen, O. (1963). On the hmit behaviour of extreme order 
statistics. Ann. Math. Statist. 34, 992-1002. 

[4] Bartlett, M. S. and G., K. M. (1946). The statistical analysis of 
variance-heterogeneity and the logarithmic transformation. J. Roy. Statist. 
Soc. Suppl. 8, 1, 128-138. 

[5] Bramwell, S. T., Holdsworth, P. C. W., and Pinton, J.-F. (1998). 
Universality of rare fluctuations in turbulence and citical phenomena. Na- 
ture 396, 552-554. 

[6] Dadpay, a., Soofi, E. S., and Soyer, R. (2007). Information measures 
for generalized gamma family. J. Econometrics 138, 568-585. 



/ 26 

[7] DE MoiVRE, A. (1738). The doctrine of chances, 2nd ed. Woodfall. 

[8] Erlang, a. K. (1909). The theory of probabihties and telephone conver- 
sations. Nyt Tidsskrift for Matematik B 20, 33-39. 

[9] Evans, M., Hastings, N., and Peacock, J. B. (2000). Statistical distri- 
butions, 3rd ed. Wiley, New York. 

[10] Feller, W. (1971). An Introduction to probability theory and Its applica- 
tions, 2nd cd. Vol. 2. Wiley, New York. 

[11] Fisher, R. A. (1924). On a distribution yielding the error functions of 
several well known statistics. In Proceedings of the International Congress of 
Mathematics, Toronto. Vol. 2. 805-813. 

[12] Fisher, R. A. and Tippett, L. H. C. (1928). Limiting forms of the 
frequency distribution of the largest or smallest member of a sample. Proc. 
Cambridge Philos. Soc. 24, 180-190. 

[13] Frechet, M. (1927). Sur la loi de probabihte de I'ecart maximum. Ann. 
Soc. Polon. Math. 6, 93-116. 

[14] Galton, F. (1879). The geometric mean, in vital and social statistics. 
Proc. R. Soc. Lond. 29, 367-376. 

[15] Gelman, a., Carlin, J. B., Stern, H. S., and Rubin, D. B. (2004). 
Bayesian data analysis, 2nd ed. Chapman & Hall/CRC, New York. 

[16] GiBRAT, R. (1931). Les inegalites economiques. Librairie du Recueil Sirey, 
Paris. 

[17] GuMBEL, E. J. (1958). Statistics of extremes. Columbia University Press, 
New York. 

[18] Gupta, A. K. and Nadarajah, S., Eds. (2004). Handbook of beta dis- 
tribution and Its applications. Marcel Dekker, New York. 

[19] Hawkins, D. M. and Wixley, R. A. J. (1986). A note on the transfor- 
mation of chi-squared variables to normality. Amer. Statistician 40, 296-298. 

[20] Jaynes, E. T. (2003). Probability theory: The logic of science. Cambridge 
University Press, Cambridge. 

[21] Jeffreys, H. (1948). Theory of probability, 2nd cd. Clarendon Press, 
Oxford. 

[22] Johnson, N. L., Kotz, S., and Balakrishnan, N. (1994). Continuous 
univariate distributions, 2nd ed. Vol. 1. Wiley, New York. 

[23] Johnson, N. L., Kotz, S., and Balakrishnan, N. (1995). Continuous 
univariate distributions, 2nd ed. Vol. 2. Wiley, New York. 

[24] Justus, C., Hargraves, W., Mikhail, A., and Denise Graberet, D. 
(1978). Methods for estimation wind speed frequency distributions. J. Appl. 
Meteorology 17, 3, 350-353. 

[25] Kleiber, C. and Kotz, S. (2003). Statistical size distributions in eco- 
nomics and actuarial sciences. Wiley, New York. 

[26] Knuth, D. E. (1997). Art of computer programming, volume 2: Seminu- 
merical algorithms, 3rd ed. Addison- Wesley, New York. 

[27] Laherrere, J. AND Sornette, D. (1998). Stretched exponential distri- 
butions in nature and economy: "fat tails" with characteristic scales. Eur. 
Phys. J. B 2, 525-539. 

[28] Lee, P. M. (2009). Bayesian Statistics: An Introduction. 3rd. Wiley, New 



/ 27 

York. 

[29] Marsaglia, G. and Tsang, W. W. (2001). A simple method for gener- 
ating gamma variables. ACM Trans. Math. Soft. 26, 3 (Sep), 363-372. 

[30] Maxwell, J. C. (1860). Illustrations of the dynamical theory of gases, 
part 1. on the motion and collision of perfectly elastic spheres. Phil. Mag. 19, 
19-32. 

[31] McAlister, D. (1879). The law of the geometric mean. Proc. R. Soc. 
Land. 29, 367-376. 

[32] McDonald, J. B. (1984). Some generalized functions for the size distri- 
bution of income. Econometrica 52, 3 (May), 647-663. 

[33] Miller, K. S. (1964). Multidimensional gaussian distributions. Wiley, 
New York. 

[34] Nakagami, M. (1960). The m-distribution - a general formula of intensity 
distribution of rapid fading. In Statistical methods in radio wave propagation: 
Proceedings of a .symposium held June 18-20, 1958, W. C. Hoffman, Ed. Perg- 
amon, New York, 3-36. 

[35] Pearson, K. (1893). Contributions to the mathematical theory of evolu- 
tion. Philos. Trans. R. Soc. A 54, 329-333. 

[36] Pearson, K. (1895). Contributions to the mathematical theory of evo- 
lution - ii. skew variation in homogeneous material. Philos. Trans. R. Soc. 
A 186, 343-414. 

[37] Pearson, K. (1901). Mathematical contributions to the theory of evolu- 
tion. X. supplement to a memoir on skew variation. Philos. Trans. R. Soc. 
A 197, 443-459. 

[38] Pearson, K. (1916). Mathematical contributions to the theory of evolu- 
tion, xix. second supplement to a memoir on skew variation. Philos. Trans. 
R. Soc. A 216, 429-457. 

[39] Prentice, R. L. (1974). A log gamma model and its maximum likelihood 
estimation. Biometrika 61, 539-544. 

[40] Smirnov, N. V. (1949). Limit distributions for the terms of a variational 
series. Trudy Mat. Inst. Steklov. 25, 3-60. 

[41] Stacy, E. W. (1962). A generalization of the gamma distribution. Ann. 
Math. Statist. 33, 3 (Sep), 1187-1192. 

[42] Strutt, J. W. (1880). On the resultant of a large number of vibrations 
of the same pitch and of arbitrary phase. Phil. Mag. 10, 73-78. 

[43] VODA, V. G. (1972). On the inverse rayleigh random variable. Rep. Statist. 
Appl. Res., JUSE 19, 13-21. 

[44] VODA, V. G. (1989). New models in durability tool-testing: pseudo-weibuU 
distribution. Kybernetika 25, 3, 209-215. 

[45] VON MiSES, R. (1936). La distribution de la plus grande de n valeurs. Rev. 
math. Union Interbalcanique 1, 141-160. 

[46] Weibull, W. (1951). A statistical distribution function of wide applica- 
bility. J. Appl. Mech. 18, 3, 293-297. 

[47] Wilson, E. B. and Hilferty, M. M. (1931). The distribution of chi- 
square. Proc. Natl. Acad. Sci. U.S.A. 17, 684-688. 



